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Abstract 


This  report  summarizes  the  initial  activities  of  the  Vision 
Information  Center  in  the  field  of  computer-assisted  instruction, 
from  December,  1966  through  August,  1967.  This  work  includes  the 
development  of  a  concordance  end  the  conversion  of  the  programmed 
textbook  Basic  Ophthalmology  (Hew  York:  Appleton-Century-Crofts , 
1967)  bv  Robert  D.  Reinecke,  M.D.  and  Robert  J.  Herm,  M.D.  ,  to 
computer-assisted  instruction  on  the  IBM  7010  and  IBM  lUOl  systems,* 
Essentially  this  report  describes  the  methodology  used  to  load 
a  large  body  of  text  onto  a  computer.  An  effort  has  been  made  to 
document  and  explain  all  stens ,  including  those  which  were  abandoned, 
in  order  to  avoid  unnecessary  duplication  in  the  future. 

This  project  is  a  joint  effort  of  the  Harvard  CAI  Laboratory 
and  Dr.  Robert  Reinecke,  whose  work  is  supported  in  part  by  U.S. 
Public  Health  Service  Contract  ITo.  PHlO-66-911 . 


•Mrs.  Theresa  Lee,  Dr.  Mary  Eickhorn,  Miss  Carol  Smith  and 
Miss  Dian  Ohnsted  assisted  with  different  aspects  of  the  work. 
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Vision  Information  Center 

ihe  Vision  Information  Center  (VIC)  was  established  to  pro¬ 
vide  computer-assisted  instruction  (CAI)  and  bibliographic  information 
retrieval  (IR)  *n  the  basic  areas  of  interest  associated  with  vision. 
Its  aim  is  to  provide  an  online  computer  station  which  will  enable 
the  inquirer  to  define  his  questions  and  then  give  him  direct  entrance 
to  and  exit  from  the  computer's  data  bank  of  bibliographic  information. 
The  idea  is  to  combine  IR  and  CAI  in  one  system  (see  Figure  l). 

In  order  to  help  relieve  the  Investigator  and  practitioner 
of  the  problem  of  the  rapid  proliferation  of  literature  and  the 
difficulty  in  storing  and  rapidly  retrieving  this  literature,  VIC 
has  undertaken  the  development  of  a  computer  based  system  to  retrieve 
upon  request  a  bibliography  pertinent  to  the  specific  Interest  of 
the  user.  In  the  system  design  the  initial  inquiry  of  the  user 
will  be  the  basis  for  selective  Instruction  by  CAI,  both  to  aid 
the  user  in  the  more  precise  formulation  of  his  question  and  to 
prepare  him  to  better  understand  the  literature  he  is  about  to  read. 

The  plan  is  to  have  the  computer  select  only  titles  of  pertinent 
literature  rather  than  to  present  him  with  an  overwhelming  and 
undifferentiated  amount  of  material,  much  of  which  is  only  peripherally 
related  to  his  subject.  Moreover,  the  computer  will  accomplish' this 
task  in  a  fraction  of  the  time  that  is  currently  required  for  working 
with  a  card  catalogue. 

The  Harvard  CAI  system  not  only  Integrates  computer-assisted 
instruction  and  information  retrieval  in  a  single  system  but  it  also 
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Fig.  1.  Vision  Information  Center  —  Harvard 

CAI  Laboratory  professional  resources  system. 

3. 


makes  these  services  available  to  the  user  by  teleprocessing.  In 
thle  way,  consoles  can  be  located  to  suit  the  convenience  of  the 
user. 

Operational  Characteristics.  The  two  major  services  of 

VIC — Information  retrieval  and  computer-assisted  lnstruction--are 

related  through  key  words  that  are  common  to  both  systems .  A 

hierarchical  system  of  key  words  concerned  with  vision,  called  the 

Thesaurus ,  has  been  developed  for  IR  and  Is  presented  to  the  user. 

Associated  with  each  word  Is  a  hierarchical  number.  When  the  user 

types  a  particular  number  or  set  of  numbers  the  computer  responds 

by  typing  out  the  bibliographic  citations  associated  with  that  number 

and  key  word.  Moreover,  the  texts  of  the  computer-assisted  Instruction 

programs  are  also  Indexed  by  key  words,  which  are  listed  In  the 

Concordance .  The  key  words  of  both  the  Thesaurus  and  the  Concordance 

receive  the  same  hierarchical  number  and  can  therefore  be  related 
2 

by  the  computer. 

As  presently  conceived,  the  VIC  will  function  as  follows: 

At  the  computer  console,  the  student  will  type  In  his  area  of 
interest  and  will  be  presented  with  both  the  Thesaurus  and  the 
option  of  receiving  programmed  instruction  on  the  subject.  Two 
alternate  routes  are  open  to  him.  First,  if  he  wishes,  he  may  re- 
cleve  Immediately  a  list  of  bibliographic  citations  only  (a  set  of 
coded  entires  In  the  data  base)  that  deal  with  the  subject  of  his 
Interest  (IR  only).  If,  however,  he  wishes  some  instruction  on  the 

2 

The  Thesaurus  and  the  Information  Retrieval  are  being  developed 
by  the  Countway  Library  Staff.  The  Harvard  CAI  Laboratory  Staff 
aaslsted  In  the  development  of  CAI. 
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mA1“t  b<f<“”  ”Celv“  “*  bibliography,  ho  may  t.k.  th.  .ecoed 
roar.  aud  request  co«put.r-...l.,.a  iaa.ruetloo  which  will  provide 
specialized  hr.oehe.  tailored  ^ 

(IR  and  CAI). 


5. 


Concordance 

Text.  The  textbook  Basic  Ophthalmology:  A  Programmed  Text, 
by  Robert  D.  Reinecke,  M.D.  and  Robert  J.  Herm,  M.D.  (1967),  is 
the  basis  for  the  computer-assisted  instruction  developed  for  the 
Vision  Information  Center.  Therefore,  it  is  the  subject  of  the 
Concordance  sort  for  keywords . 

The  text  consists  of  656  frames  (the  details  of  the  programmed 
instruction  format  will  be  discussed  in  detail  in  the  section  on 
CAT)  and  approximately  30,000  words. 

Keypunch  Format.  The  entire  textbook  was  keypunched  on  IBM 
cards  to  allow  for  this  processing.  Columns  1-72  are  for  text  and 
73-78  indicate  the  frame  number  and  the  card  number  per  frame.  For 
example,  number:  001002  means  Frame  1  card  2  (see  Figure  2  for 
details) . 

Program:  Soccer.  The  program  used  to  develop  the  keyword 
concordance  was  "Soccer";  the  programmer  was  Miss  Carol  Smith, 
applications  programmer  of  the  Harvard  Computing  Center.  The  pro¬ 
cessing  was  done  on  February  15,  1967  and  execution  took  19.6  minutes 

Approximately  2,700  distinct  words  types  were  found.  The 
only  words  that  were  placed  on  the  restriction  list  were  an,  a,  and 
the.  Details  of  the  word  occurrences  are  summarized  in  Figure  3. 

A  copy  of  a  portion  of  one  page  is  Included  in  this  report 
as  Figure  4.  This  is  only  a  portion  of  the  listing  for  the  entry 
"eye"  which  is  listed  468  times.  (Other  references  which  follow 
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Fig.  2.  Concordance — Card  Format — Keypunch  Instructions 


POST- PROCESSING  DATA  FROM  SOCCER 


2/15/67 


A  total  of  29,910  words  were  processed,  of  which  3,994 
weic  on  the  restriction  list, 

2,706  distinct  types  not  on  the  restriction  list  were 
found. 


1,016  words 

occurred  once  in  the  text. 

1*23  words 

occurred  2  times. 

252  words 

occurred  3  times. 

160  words 

occurred  4  time3 . 

120  words 

occurred  5  times. 

95  words 

occurred  6  times. 

74  words 

occurred  7  times . 

50  words 

occurred  8  times. 

**5  words 

occurred  9  times . 

32  words 

occurred  10  times. 

The  most  common  words  not  on  the  restriction 
listed  below. 

Occurrences 

Word 

1,296 

of 

925 

is 

7U1 

ca 

598 

and 

596 

in 

585 

to 

468 

eye 

308 

be 

286 

or 

249 

with 

The  restriction  list  contains  three  entries. 
Occurrences  of  these  entries  are  below. 


Occurrences 

Entry 

219 

an 

844 

a 

2,931 

the 

Execution  took  19.6  minutes. 


Fig.  3.  Results  obtained  from  the  analysis 
of  the  frames  of  Basic  Ophthalmology . 
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Fig.  4.  Concordance. 
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alphabetically:  concord  eyeball,  eyeballs,  eyed,  eyelashes,  eyelid, 
eyes).  Every  time  the  word  appears  it  Is  listed  in  the  center  of 
the  program  within  the  context  of  the  words  that  immediately  pre¬ 
cede  and  follow  it  in  the  textbook.  In  the  right  hand  column, 
the  numbers  Identify  the  frame  number  and  also  the  IBM  card  in  which 
a  particular  occurrence  of  the  word  la  located  (see  Figure  2,  the 
keypunch  Instructions).  For  example,  on  page  269  of  the  program 
(Figure  4)  the  first  mention  of  the  word  "eye"  is  on  frame  617, 
card  #2. 

The  words  are  Hated  by  alphabetical  groups  with  each  group 
in  ascending  numerical  order  by  frame  number. 

Pilot  Concordance.  A  pilot  Concordance  was  run  on  Frames  1-49 
first  on  Jai.uary  19,  1967,  to  test  the  program  for  accuracy  and 
appropriateness . 

The  Task.  The  task  was  to  load  tne  programmed  linear  text 
Basic  Ophthalmology:  A  Programmed  Text,  of  approximately  30,000 
words,  onto  the  computer,  complete  with  commands  to  show  slides. 

Its  conversion  to  the  form  of  CAI  was  divided  into  two  stages: 

Stage  I  Included  (a)  loading  the  linear  programmed  text  on 
the  CAI  system,  in  essentially  the  same  form  as  it  appeared  in  the 
textbook,  and  (b)  collecting  student  responses  to  the  frames.  The 
Hear  text  was 'tested  by  medical  students  through  the  use  of 
both  the  on-line  CAI  system  and  the  published  text  of  the  book  in 
its  test  edition. 

Stage  II  included  (a)  editing  and  changing  the  loaded  program 
based  on  an  analysis  of  student  answers.  The  process  of  data 


10. 


analysis  will  be  discussed  In  the  section  on  the  IBM  1401,  but 
essentially  It  involves  determining  the  students'  wrong  answers, 
writing  branches  and  then  editing  the  existing  linear  frames  to 
provide  supplementary  remedial  Instruction  in  these  areas  of  diffi¬ 
culty.  (b)  A  second  group  of  students  will  test  the. edited  program, 
with  branches.  Ocher  modifications  will  be  made  and.  If  no 
further  major  changes  are  necessary  the  program  will  be  available 
for  use.  The  on-line  editing  capability  of  the  computer  allows 
other  branches  to  be  added  from  time  to  time  to  keep  the  program 
up-to-date  with  growing  student  use  and  to  constantly  expand  Its 
branching  possibilities. 

Coursewrlter.  The  programming  language  used  was  Coursewriter , 

which  was  compatible  with  the  IBM  7010  computer  in  The  Thomas  J. 

Watson  Research  Laboratory  at  Yorktown,  New  York.  The  complete 

details  are  given  In  the  7010  Coursewrlter  manual  available  from 

3 

the  IBM  Yorktown  laboratory. 

The  Test  Course:  baaophth.  The  first  stage  of  loading  Basic 
Ophthalmology  onto  the  CAI  system  was  to  load  a  small  test  deck 
called  baaophth  In  order  to  test  the  correctness  of  the  programming 
format  and  the  loading  and  editing  procedures.  Simultaneously,  we 
experimented  with  other  test  courses  to  enable  us  to  make  editing 
changes  without  Interfering  with  the  content  of  baaophth.  The 
printouts  of  these  courses  have  been  bound  separately  and  are 
labelled  annalOS.  testrun,  and  tesophth2. 

3Mr .  Thomas  Hartman  coordinated  this  work. 
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Frames  1-6  were  cutered  by  keypunch  and  frame  11  was  entered 
on-line  during  the  week  of  April  1,  1967.  They  were  accessible  as 
teaching  units  to  the  students,  complete  with  commands  to  display 
slides. 

Coding .  Frames  1-6  were  taken  from  the  text  and  hand  coded 
on  IBM  coding  sheets  by  Barbara  Ricker  and  Judith  Sellg.  A  detailed 
explanation  of  the  coding  format  is  given  in  the  section  on  baalcoph. 

Keypunching .  Keypunching  was  done  most  effectively  at  the 
Harvard  Computing  Center,  where  the  deadline  is  guaranteed,  the 
80.80  listing  is  provided  and  accuracy  is  very  high.  The  material 
was  proofread  In  Cambridge  and  keypunch  errors  were  corrected 
before  the  deck  was  mailed  to  Fork town,  so  that  any  changes  which 
were  necessary  after  the  material  had  been  entered  would  probably  be 
changes  of  format  and  not  clerical  spelling  errors. 

Card  Duplication.  Next,  the  cards  were  duplicated  at  the 
Harvard  Computing  Center  and  the  duplicate  deck  mailed  to  Yorktown 
for  card  loading. 

We  thought  it  advisable  to  keep  the  original  deck,  or  a  copy, 
at  the  Computing  Center  In  case  the  mailed  copy  should  be  lost  or 
damaged.  Also,  In  case  any  duplications  were  Incorrect  In  the  mailed- 
out  version,  we  would  still  have  the  original  good  version  In  our 
possession  and  would  not  have  to  rely  on  the  Yorktown  lab  to  send 
us  a  copy  of  Its  deck  (a  process  which  is  time-consuming  and 
Inconvenient  and  might.  Indeed,  be  overlooked). 

The  duplication  of  these  decks  demands  extreme  care  sirce 
some  of  the  multiple  punches  (e.g.  11,  5,  9)  are  used  only  in  the 


12. 


Coursevrlter  system,  and  hence  are  regarded  as  illegal  characters. 
Experience  showed  that  the  original  deck  should  be  duplicated  on  the 
1401  since  that  computer  will  process  and  duplicate  the  "illegal"  key¬ 
punches.  Each  duplicated  deck  should  then  be  compared  card  to  card 
with  the  original  (in  a  spot  check)  to  be  certain  the  duplication  is 
accurate.  A  card  listing  is  also  helpful. 

Card  Loading.  Next,  the  cards  were  mailed  to  Yorktown  for 
card  loading. 

Compile  Listing.  The  Yorktown  lab  immediately  sent  us  a 
compiled  listing  of  the  entire  course  entered  to  date. 

Editing .  The  course,  in  the  student  mode,  was  taken  by  Miss 
Sellg  several  times  at  the  1050  console  located  in  the  Masaichisetts 
Eye  and  Ear  Infirmary,  28  Emerson  Place,  Boston  in  order  to  test  the 
program.  In  the  course  of  this  testing,  an  editing  form  was  devel¬ 
oped  to  enable  the  author  to  go  through  each  frame  several  times, 
testing  several  different  aspects  of  the  program  (see  Figure  5  for 
an  example). 

In  addition,  a  second  editing  form  was  developed  to  facilitate 
on-line  changes.  Theoretically,  if  the  form  is  filled  out  with 
complete  information,  a  typist  who  knows  nothing  about  the  course 
per  se  but  knows  some  Coursewriter  and  how  to  operate  a  1050 
console  can  enter  the  material  on-line  (see  Figure  6). 

Results.  In  addition  to  affirming  the  validity  of  the  pro¬ 
gramming  we  made  two  important  observations  based  on  thertest 
course  basophth: 


Frame  Number  ML 


Fig.  5 
the  IBM  7010 
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7010 


KW 

KWO 

FN  KWO 

NX  TY 

Comments 

| 

of  Edit  Form  for 


Edit  Form  -  7010 


Additions  and  Corrections  to  Text 


Space 


Sequence  No.  TAB  LABEL  TAB  Op  Code  C/R 


Fig.  6.  Supplementary  form  for  editing. 
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1.  Hand  coding  for  keypunch  is  definitely 
not  practical  and  reproducing  card  decks 
would  be  very  helpful. 

2.  Die  two  editing  forma  are  helpful. 

Baaicoph — Card  Loading.  While  the  logic  of  the  Couraewriter 
language  ia  relatively  simple  and  eacy  to  apply,  the  actual  proceaa 
of  entering  the  material  into  the  computer  requires  great  exactness 
of  detail. 

In  coside ring  how  to  enter  Basic  Ophthalmology  in  Coursewrlter 
form,  we  chose  card  loading  instead  of  on-line  entry  for  the  follow¬ 
ing  reasons: 

1.  the  course  already  existed  on  previously  punched 
IBM  cards  (for  the  Concordance) 

2.  Its  pattern  of  programming  would  be  uniform 

3.  It  was  a  substantial  body  of  material  (30,000  wofds) 
See  Figure  7  for  details. 

Keypunch  Coding.  A  Master  Coding  Sheet  giving  the  details  for 
program. flow  and  keypunch  .specifications  for  erne  frame  was  written. 
This  was  the  standard  form  for  all  frames.  It  was  quickly  evident  how 
much  of  the  coding  was  repetitious  and  could  be  reproduced  (see 
Figure  8). 

The  coding  underlines  in  red  (thin  lines)  is  Identical  in  every 
froe.  The  coding  underlined  in  green  (thick  lines)  can  be  mechan¬ 
ically  sequenced. 

Moreover,  some  of  the  coding  is  extremely  exacting,  requiring 
two  or  three  numbers  in  one  IBM  card  column  (multiple  punches).  See 
Figure  8;  Figure  9  for  further  details. 
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1.  Basic  Ophthalmology:  A  Programmed  Text — linear  form, 
on  keypunched  card  deck,  called  Input  deck. 

i 

2.  Rewrite  one  frame  on  basic  Coureewrlter  form — program 
flow  only. 


3.  Write  Master  Coding  Sheet — the  Coureewrlter  format 

for  keypunching — with  exact  specifications  as  to  column 
position  and  multiple  punch  combinations. 

A.  Analyze  Master  Coding  Sheet  to  determine  which  of 
the  op  codes  and  statements  can  be  reproduced  and 
which  can  be  taken  from  the  original  Input  deck. 

/  ' 

5.  Reproduce  uniform  cards  Transcribe  Input  deck  on 

new  cards  In  Couraevriter 
format  called  Conversion 
deck. 

1 ( 

6.  Manually  collate  the  two  decks  according  to  Master 
Coding  Sheet  pattern. 


Fig.  7.  Steps  In  the  Card  Loading  Procedure. 


Mftster  Coding  Fheet 
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Couraev  r iter  Symbol 

]  Carriage 
return 

[  tab 


upshift 


downshift 


EOB 


pre  A  red  shift 
Prefix  A 


Keypunch  Coding 

11 

5 

9 

12 

5 

9 


6 

9 

12 

6 

9 

0 

6 

9 

0  12 
7  1 
9 


pre  B  black  shift 
Prefix  B 


0  12 
7  2 
9 


Print -out  Symbol 


) 


(A 


(B 


Fig.  9.  Symbols  for  special  characters 
used  in  keypunching  for  the  IBM  7010. 
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Reproducing.  The  advantages  of  reproducing  cards  that  are 
repeated  consistently  and  In  great  quantity  throughout  the  program 
cannot  be  overestimated  (see  Figure  10). 

An  examination  of  the  master  programming  sheet  reveals  that 
80Z  of  the  programming  op  codes  are  uniform  or  of  largely  repeated 
patterns  throughout  the  entire  program  of  Basic  Ophthalmology.  The 
actual  number  of  cards  this  represents  is  SOX  of  the  total  number 
of  5,000  cards  entered.  To  hand  code  these  cards  for  keypunching 
would  be  a  formidable  task  Indeed.  The  coder  would  have  to  keep  In 
mind  not  only  the  general  flow  of  the  program  and  order  of  op  cedes, 
but  also  the  exact  form,  the  detail  of  multiple  punches,  EOBs, 
etc.  Moreover,  the  possibilities  of  «rror  are  enormous  when  one 
considers  the  fallibility  of  the  hand  coder  and  the  keypuncher. 

The  time  required  for  proofreading  these  cards  would  also  be  enor¬ 
mous  because  the  coding  must  be  exact  in  respect  to  column  posi¬ 
tion,  multiple  punch  combination,  etc.  or  the  op  code  will  not 
be  executed. 

Therefore,  it  seemed  much  wiser  to  reproduce  the  repeated 
cards  and  manually  combine  them  with  the  converted  deck.  In 
contrast  to  the  Individual  coding  method,  the  reproduced  cards 
need  to  be  hand  coded  only  once,  keypunched  only  once  and  proofread 
only  once.  They  may  then  be  duplicated  literally  by  the  thousands, 
the  collater  merely  collating  stacks  of  cards  in  a  given  order,  much 
as  one  collates  the  pages  of  a  manuscript.  The  entire  process, 
a  highly  technical  one,  can  be  reduced  to  a  relatively  simple 
clerical  task,  at  a  great  saving  of  time  and  expense. 
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X  of  op  codes 

%  of  cards 

Reproduction 

80Z 

50% 

Conversion 

Deck 

20% 

50% 

Fig.  10.  Reproduction  and  Conversion  Deck  Ratio. 
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7010  Mass  Production  Coding  Forms.  When  hand-coding  was 
necessary  and  there  vas  still  a  great  repetition  of  detail ,  the  coding 
sheet  vas  filled  out  with  the  repetitious  parts  and  reproduced  by 
Xerox.  Then  the  additional  information,  vhich  changes  in  every 
slide,  was  filled  in  where  appropriate  (see  Figure  11).  Arrows 
indicate  the  places  where  additions  are  needed. 

The  details  of  writing  a  donversion  program  are  discussed 
in  the  section  on  the  IBM  lhOl  since  that  is  the  program  currently 
in  use. 

Collating.  See  Figure  12  for  the  steps  in  the  collating 
process . 

Moreover,  color  coding  can  facilitate  the  process.  We 
reproduced  different  op  codes  on  cards  of  different  colors: 

ML  (label)  -  blue 

FPO  and  FP1  -  beige  with  top  orange  stripe 

(slide  commands) 

NX  -  pink 

FN  ED 

KW  -  yellow 

KWO 

TC  -  orange 

QU  and  CA  -  heige  with  top  yellow  stripe 

(conversion  deck) 

Card  Loading.  After  the  course  was  collated  it  was  dupli¬ 
cated  and  divided  into  13  separate  and  smaller  courses.  They  ranged 
in  name  from  baslcophl  through  basicophl3.  Shorter  courses  facilitate 


'  | 

Fig.  11.  Mass  production  for  1  CA-Coding  Sheet  (partial). 
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1.  Collate  reproduced  material 

a. 

NX 

fn  ed 

ty  Correct. 

NX 

ty  correct 
NX 

b. 

ml  and  FPi. 
ml  and  FPO 

c. 

combine  groups  a  and  b 

2.  Insert  Conversion  deck  in  the  collated  reproduced  deck 

3.  lucert  KW//  and  KWO//  cards  in  combined  decks 
1* .  Add  lead  Cards 


Tig.  12.  Steps  in  collating. 
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compiling  after  editing  on  the  IBM  7010  (see  Figure  13  for  the  index 
of  course  names — the  frame  numbers  included  in  each  course  and  the 
course  sequence  numbers).  The  courses  are  connected  by  an  automatic 
connect  function  vhich  enables  the  student  to  go  from  course  to 
course  without  interruption.  Hence,  it  is  necessary  to  have 
continuous  sequence  numbers . 

A  duplicate  copy  of  the  deck  was  mailed  to  Yorktown  and 
compile  listings  of  basicophl-3  were  returned. 


On-line  Baaicoph.  To  sign  on  the  system  for  basicoph  at 
Yorktown  one  needs  to  know  the  following  information: 


Yorktown — 7010 
Sign-On  Information 


basicoph 

■ 

(course  name) 

bl079 

m 

(author/student  number) 

hvic. 

m 

(author /student  name) 

heal 

m 

(school) 

The  exact  process  for  sign-on  in  both  the  author  and  student  modes 
is  given  below. 


25. 


Sign-On — baaicophl 
AUTHOR  Mode 


Computer 
Author 
Compute r 
Author 


(Proceed  light  goes  on) 

(Press  EOB) 

Make  a  request 

Coursewriter ,  baaicophl,  bl079 


Sign-On — baaicophl 
STUDENT  Mode 


Computer 

:  (Proceed  light  goes  on) 

Student 

(Press  EOB) 

Computer 

Make  a  request 

Student 

bl079,  besicophl,  hvic 

The  computer  will  automatically  begin  where  the  student 
stopped  the  previous  time.  To  go  to  the  beginning  of  the 
course,  press  the  carriage  return  button,  type  AB-0010-020 , 
press  EOB  (2  red  buttons). 


Multiple  Program  Patterns.  In  the  early  stages  of  programing 
baslcoph  for  the  IBM  7010  we  thought  of  hawing  several  different 
types  of  program  for  several  different  types  of  frames . 


Frame  No. 

Sequence 

baslcophl 

0-1*9 

AC- 

basicoph 2 

50-99 

BC 

100-101 

BD 

basicoph3 

102-122 

CC*-' 

basicoph  1* 

123-196 

DC- 

baaicoph5 

197-239 

EC 

basicoph6 

21*0-293 

FC 

basicoph? 

29  U- 335 

CC 

basicophS 

336-399 

HC 

basicoph 9 

1*00-1*1*9 

IC 

basicophlO 

1*50-503 

JC 

basicoph 11 

50U— 51*9 

KC 

basicophl2 

550-599 

LC 

basicophl3 

600-656 

MC 

Pig.  13.  Course  index  for  basicoph. 
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We  found  that  the  656  frames  of  the  programmed  text  Basic 
Ophthalmology  can  be  divided  into  several  distinct  and  often 
repeated  patterns  of  CAI  programming.  Distinctions  were  drawn 
between  the  frames  on  the  basis  of  the  number  of  CA's,  whether  the 
CA'a  were  ordered  or  not,  and  whether  there  were  any  CB’e  or  syno¬ 
nyms  or  any  alternate  forms  of  CA's.  Each  pattern  of  program  format 
was  given  a  distinct  number,  and  this  number  was  marked  next  to  hhe 
frame  in  th»  margin  of  the  programmed  textbook  (copy  111)  for  easy 
referral  (see  Figure  1*»  for  definitions  of  types). 

Then  we  began  the  calculating  of  a  frequency  distribution 
of  the  number  of  occurrences  of  each  pattern. 

The  plan  was  to  develop  mass  production  coding  methods  for 
all  the  different  types  of  CA's.  Ideally,  this  procedure  vould  have 
provided  a  more  detailed  and  individualized  conversion  to  CAI  than 
one  uniform  format.  However,  we  had  only  a  few  weeks  to  load  the 
course  onto  the  IBM  7010  system.  In  addition,  the  amount  of  antici¬ 
patory  coding  for  misspelled  words  in  mutiple  CAI  frames  vas  enor¬ 
mous,  and  we  were  not  at  all  sure  that  the  variations  would  be 
used  by  the  students.  Therefore,  we  decided  to  wait  for  empirical 
data  on  what  wrong  answers  the  students  actually  gave  and 
proceeded  to  enter  the  course  in  its  linear  form. 

Wrong-Answer  Processing.  The  Basic  Ophthalmology  course  in 
textbook  form  has  been,  and  will  be,  given  to  medical  students, 
interns,  residents,  and  related  personnel.  We  plan  to  record 
their  wrong  answers  and  then  write  branches  for  the  CAI  version 
of  Basic  Ophthalmology  to  expand  on  these  areas  of  difficulty. 


Number  of  CA'a 


28. 


1 

1 

1+ 

Ordered 

2 

2 

2+ 

3 

3 

3+ 

4 

4 

4+ 

5 

5 

5+ 

6 

6 

6+ 

Any  Order 

12 

2 

12+ 

13 

3 

13+ 

14 

4 

14+ 

15 

5 

15+ 

16 

6 

16+ 

0 

no  coding 

20 

no  CA'a  (rd  -  ty  statement) 

2x 

students  sketch  their  response 

22 

emit  the  frame  from  the  CAI 

♦ 

CB 

Fig.  14.  Program  pattern  types. 
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Student's  Taak.  Students  are  allowed  to  keep  their  copy  of 
the  textbook  if  they  copy  their  wrong  answers  on  individual  3x5 
cards  in  the  following  manner : 

1.  The  frame  number  apr<-  Ars  in  the  upper  left  hand 
corner . 

2.  The  student  I.D.  number  which  corresponds  to  the 
previously  assigned  number  of  the  book  appears  in 
the  upper  right  hand  corner. 

3.  The  text  is  written  on  the  face  of  the  card,  and 
continued  on  the  back  of  the  same  card  if  necessary. 


3*frame  number 
.  100* frame  number 


Keypunch  Format.  Next  the  wrong  answers  are  keypunched  on 
80  column  IBM  cards  to  provide  for  computer  data  processing  (see 
Figure  15). 

Column  Number. 

1  ■  Basic  Ophthalmology  text ,  is  always  2  for 

this  processing 

2,  3  ■  Institution  identification  number  (see 

Figure  16) 

U  *  Month  of  the  year  (see  Figure  17) 

5,  6  ■  Year 


7 


■  Blank 
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8,  9.  10  *  Frame  number  (3  digits,  all  columns 

punched,  wse  leading  zeros  if  necessary) 
11  •  Blank 

12,  13,  l1*,  15  *  Student  Identification  Number 

16,  17  ■  Blank 

18-72  *  Incorrect  Answer 

If  text  of  comments  continues  to  a  second  card,  duplicate 
columns  1-17  and  continue  text  in  column  16.  (In  key¬ 
punching,  substitute  )  ^  for  ^  ,  since  there  is  no 

jS\  on  the  keypunch . ) 


A  ’ 


V 

:Vj 


‘5  -a. 
£  ? 
*4  ‘«4 

A  l 

' ^ 


'i 

fc 

*\ 

N 

‘>1 

V 

v 


•e: 

a 


K 


j  ;'  ■/  '  ;•' .  ' : 

!  \  r  !  r!i  i;  !:’» 

^  |  l  i  ii|  il 

•  *  *3.4  ;i" 

.  •»  ! 

i  ‘  '-Ti 
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c  i  ! 


>  / 

in 


A<: 

'^j 


k  . 


(Yi 


i  ;  l 

!,  !  i 


I  M  :  I 


(^’a  »*m  pl<T 


i  i 


o  • 


I  ! 


•i  I 


i  i 


I  I 


I  I 


>  I  !  ! 


I  > 
!  ! 
!  r 


f*>3  '.  '**{•!! 


!  ! 


i  i 


i  l 


:  I, 

TEXT  NOT^lEPKDDUGIBliE 


Jr  •  '.wjjg'.U-  '>-  •••  <■•••-  ■■■  w  '‘ • 

Fig.  15.  Keypunch  format  for  processing 
students'  wrong  answers. 
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Code  Humber  Institution  Name 

11  Vanderbilt  Medical  School 

12  West  Virginia  Medical  School 

13  Laboratory  Assistants,  not  M.D. 

or  Student  M.D. 

lU  Harvard  Medical  School 

15 

16 

17 

18 
19 


Fig.  16.  Keypunch  coding  of  names  of  institu¬ 
tions  for  Basic  Ophthalmology  course. 
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Code  Number 

Month 

1 

n 

Jan. 

2 

=- 

Feb. 

3 

m 

March 

4 

m 

April 

5 

■ 

May 

6 

m 

June 

7 

s 

July 

8 

= 

Aug. 

9 

u 

Sept. 

0 

m 

Oct. 

-(u  punch) 

m 

Nov. 

♦( 12  punch) 

m 

Dec. 

Fig.  17.  Keypunch  coding  of  nanee  of  months 
for  Basic  Ophthalmology  course. 


IBM  lUOl— Providence 


CAI  Loading.  On  August  8,  1967,  the  Basle  Ophthalmology  textbook 
vas  loaded  on  the  IBM  lbOl  CAI  system  at  Providence  College  (see 
Figure  18  for  details  of  the  system).  It  vas  loaded  in  the  linear  form, 
parallel  to  the  format  of  the  textbook,  in  the  Texas  version  of  the 
Cours writer  language  used  at  Providence  College.  The  next  step  la 
to  write  branches  to  the  text  and  add  them  to  the  existing  system. 

Medical  students  read  the  text  in  book  form  and  their  errors 
are  recorded.  Branches  for  the  CAI  system  will  be  written  on  the 
basis  of  these  errors.  The  principle  behind  writing  branches  for 
the  Basic  Ophthalmology  text  is  not  to  predict  student  errors, 
except  in  specific  limited  instances,  but  to  incorporate  those  that 
are  known  to  occur. 

Conversion  Program.  Since  the  text  of  Basic  Ophthalmology 
vas  already  on  keypunch  cards  (it  vas  punched  to  produce  the  Con¬ 
cordance)  and  because  on-line  time  is  scarce  and  expensive,  we  decided 

U 

to  card- load  the  material.  Judith  Selig  provided  the  basic  pattern 
of  program  flow  from  the  7010  Master  Coding  Sheet  and  Mrs .  Theresa  Lee 
translated  it  into  the  lbOl  version  of  Coursevriter  keypunch  coding; 
from  this,  Mr.  Bromley  wrote  the  conversion  program. 

**Mr.  A1  Bromley,  Systems  Programmer,  wrote  the  Conversion 
Program  from  the  'Original  input  Concordance  deck  to  the  IBM  IbOl 
format. 


As  In  the  7010  program,  tho  majority  of  the  coding  is  repetitious 
end  can  be  reproduced.  However ,  instead  of  reproducing  and  manually 
collating  the  cards ,  we  arranged  to  have  tne  lUOl  program  generate  and 
place  the  repetitious  cards.  The  only  ones  that  had  to  be  manually 
collated  were  the  ccmanda  to  display  and  remove  slides,  since  they 
were  not  present  in  the  original  input  deck.  These  cards  were  gener¬ 
ated  separately  mad  then  inserted.  The  complete  deck  was  duplicated 
and  the  original  copy  taken  to  Providence  College  for  card  loading. 

Conversion  Flags.  In  order  to  produce  a  Coursewriter  deck  from 
a  plain  input  deck,  two  major  flags  are  needed.  One  must  show  the 
beginning  of  the  question  text  and  the  other  the  beginning  of  the 
answer  text,  in  order  to  delimit  the  two.  QU  for  question  and  CA  for 
answer  served  our  purpose,  since  they  are  consistent  with  the  Course- 
writer  programming,  but  any  symbol  would  be  sufficient.  If  the  slide 
numbers  are  present  in  the  input  deck,  then  the  Coursewriter  slide 
coman  da  can  also  be  generated  and  sequenced. 

In  addition,  it  is  a  good  rule  to  keypunch  sentences  in  the 
conversion  deck  by  ending  them  with  a  period  and  spacing  twice  before 
beginning  a  nev  sentence.  Then  the  computer  conversion  program  can 
be  programed  to  capitalize  the  third  character  after  a  period: 

_  T  H  E 
12  3 

In  this  way  capitalization  in  the  input  deck  can  be  provided  with 
a  minimum  of  error. 

Editing  the  1401  Program.  After  the  conversion  program  was 
completed,  a  lUOl  CAI  version  of  Basic  Ophthalmology  was  produced. 


Providence  Colie 
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We  found  Chat  a  great  deal  of  editing  was  necessary  to  make  the  program 
ready  for  students,  so  we  utilized  the  on-line  time  for  this  Job. 

Of  course,  the  printout  was  hand-edited  prior  to  on-line  text  editing. 
Approximately  80  hours  of  on-line  time  were  required  to  edit  the  program. 

Student  Participation.  Several  ophthalmic  assistants  were  asked 
to  take  the  Basic  Ophthalmology  course  at  the  console.  They  found 
the  experience  stimulating;  their  Interest  was  maintained  for  as  long 
as  two  hours  of  continuous  on-line  time.  Unrecognized  answers  or  wrong 
answers  were  keypunched  on  cards  and  Identified  by  appropriate  frame 
numbers.  These  cards  were  then  sorted  according  to  the  frame  numbers 
and  used  to  produce  a  printout  to  evaluate  student  responses . 
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Summary 

This  report  briefly  describes  the  Harvard  University  professional 
support  system  combining  computer-assisted  instruction  and  information 
retrieval.  It  also  details  the  procedures  used  in  converting  a  linear 
self-instructional  program  to  computer  form  so  it  could  be  run  under 
Coursewriter,  first  on  an  IBM  7010  and  then  on  an  IBM  1401.  Procedures, 
forms,  ar.d  findings  are  described.  Further  use  is  planned  for  the 
program  which  now  has  been  converted  to  a  third  system. 
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